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Various Liouville type theorems for conformally invariant equations have been 
obtained by Obata ([9]), Gidas, Ni and Nirenberg ([4]), Caffarelli, Gidas and Spruck 
([1]), Viaclovsky ([10] and [11]), Chang, Gursky and Yang ([2] and [3]), and Li and 
Li ([5], [6] and [7]). See e. g. theorem 1.3 and remark 1.6 in [6] where these results 
(except for the one in [7]) are stated more precisely. 

In this paper we give a general Liouville type theorem for conformally invari- 
ant fully nonlinear equations. This extends the above mentioned Liouville type 
theorems. 

For n > 3, let S nxn be the set of n x n real symmetric matrices, S+ Xn C S nxn be 
the set of positive definite matrices, and let 0(n) be the set of n x n real orthogonal 
matrices. 

For a positive C 2 function u, let 

Am 2 _i±2„o 2n __22_„ „ 2 __22_,„ 9r 

A u : = -u ™-2V w+t — ™- 2 Vw<g> Vw - — rrti "- 2 Vw /, 

n — 2 [n — iy [n — ly 

where / is the n x n identity matrix. 

Let U C S nxn be an open set satisfying 

0- x UO = U, VOG 0(n) (1) 

and 

U D {M + tN\ < t < oo} is convex for V M G <S nx ", V G S+ Xn . (2) 
*Partially supported by NSF Grant DMS-0100819. 
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Let F G C\U) satisfy 

F(0 _1 MO) = F(M), VM eU,Oe 0(n) (3) 

and 

(i^(M))>0, VMeU, (4) 

where = ^-(M). 

Theorem 1 For n > 3, let U C <S nxn &e open and satisfy (1) and (2), and let 
F G C 1 (?7) satisfy (3) and (4). Assume that u G C 2 (R n ) is a positive function 
satisfying 

F{A U ) = 1, A u G U, on R n , (5) 

and 

An < 0, on R n . (6) 

Tnen /or some x E R n and some constants a > and 6 > satisfying 2b 2 a~ 2 I G ?7 
and F{2b 2 a' 2 I) = 1 



a ■ n " 2 



n x 



= Lwi -12 ) 2 > g zr. (7) 

v 1 + ¥ \x — x r 7 



Remark 1 If U has the property that 

n 

Trace(M) := ^ M u > 0, V M G E/, (8) 
i=i 

t/ien any positive solution u of (5) automatically satisfies (6). 

Remark 2 When b = in (7), then u = Constant, A u = 0, G U, and F(0) = I. 

Let B R (x) C -R™ denote the ball of radius R centered at x, and let B R = B R (0). 
Lemma 1 For n > 1, R > 0, let £ G C 2 {B R \ {0}) satisfy 

A£>0 m J B R \{0} ) (9) 

and 

inf f > -00. (10) 

Br\{0} 



3 



Assume that there exist rj, ( G C 1 (Sr) satisfying 

At] > 0, AC > 0, in Br in the distribution sense, (11) 

7/(0) = C(0), (12) 

VrKO)^VC(O), (13) 

and 

£<7,, e<C, inB R \{0}. (14) 

Then 

limsup£(x) < r/(0). (15) 



Remark 3 If we further assume that r), ( G C 2 (Br), then hypothesis (10) is not 
needed in Lemma 1. This can be deduced easily from Lemma 2 by letting £ = — u, 
rj = —w and ( = —v. 

Proof of Lemma 1. Replacing £, r/ and £ by 

i(x) = £(x) - Vr/(0) • x + |Vr/(0)|i?+ 1 - inf £, 

fj(x) = rj(x) - Vr/(0) • x+ |Vr/(0)|i?+ 1 - inf f, 

B fl\{°} 



and 



C ( x ) = C ( x ) _ V r;(0) • x + |Vr/(0)|i?+ 1 - inf f 



respectively, we may further assume that 

Vr/(0) = 0, (16) 

£>1 mB R \{0}. (17) 

Without loss of generality, we may assume that R—l. By (13) and (16), VC(0) ^ 0. 
After making a rotation, we may assume that 



dx\ 



(0) |VC(0)| < 0. (18) 



Since £ G L^ c (Bi) and Af > in £i \ {0}, we know that A£ > in B 1 in the 
distribution sense. Consequently, 

m<77^[ £, V0<|y|<l, V0<r<l-|y|. (19) 

|B r (j/)| JB r (y) 
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Since £ G C 1 (i?i) satisfies (18), there exists < S < \ such that for V e G R n with 
|e| = 1 and e • e\ > 1 — 5, we have 

VC(ar) • e < -5, V \x\ < 5. (20) 

where e± — (1, 0, • • • , 0). 

Let Sj := {i G R n \ {0}| jfj • ei > 1-5}. Now we fix the value of 5. In the following, 

we will choose small positive numbers r and t satisfying < t < -f^ < Jj, and we 
will show that for some positive constant c, depending only on 5, n and r, we have 

< r/(0) - c, V0<|y|<*. (21) 

For < |y| < t, we have, by using (14), (16), (19), that 

\B r (y)\ J B r {y) \B r {y)\ JB r (y)\S s JB r (y)nS s 



= T5Tvif (v(0) + o(r))+ [ (} 



where o(r) satisfying lim = 0. 



r^0 



First recall that \y\ < t < ^, 

( v (0) + o(r)) = 7/(0)|S r (y) \S S \ + o(r n+1 ). 



lB r (y)\S s 

Next recall that ( satisfies (20), 1 < £ < C and \y\ < t < ^, 
/ C < / C = / ( / ds 

JB r (y)nSs JB r+MnSg JO JdB s nS s 

< C V \L (C(0)-Ss))ds 

Jo v JdB s llS s ' 

= c(o)\B r+]y] ns s \--^—\dB 1 ns s \(r + 

< C(0)\Br+2\y\(v) n 5,1 - -4t|3Bi n ^|r" +1 

71/ ~y~ A. 

Since C(0) = ??(0), we deduce from the above that 

C(y) < ,7T^M0)l^(?/)\^| + o(r" +1 ) + 77(0)1^1,1(2/) n5i 



n+1 
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' , dB 1 nS s \r n+1 } 



n + 1 



1 



= m + \BM\ {v{mBr+m{v) v Briy)) n ^' 

+0 (r n+1 ) -\dB 1 n <S 5 |r n+1 } 

n + 1 

Now fix some small r satisfying < r < | and o(r n+1 ) — 2(n ^ | _ 1 - ) |<9-Bi n S , 5|r n+1 < 0. 
Since 

\B r+2lyl (y)\B r (y)\<C(n)r n - l \y\, 
we can fix a smaller t satisfying < t < jq such that 

CYnWOV™- 1 * - - r\dB 1 n S 5 |r n+1 < 0. 

v 7 /v ' 4(n + 1) 

With these choices of r and i, we have 

Estimate (15) follows from the above. Lemma 1 is established. 

□ 

Lemma 2 For n > I, R > 0, Ze£ n G C 2 (S R \ {0}) safe/?/ Au < in B R \ {0}. 
Assume that there exist w, v e C 2 (Br) satisfying 

Aw < 0, At; < in 

tu(0) = v(0), Vw(0) ^ Vv(0), 

and 

u>w, u>v, in B R \{0}. 

Then 

liminf n(x) > u>(0). 



Proof of Lemma 2. By adding a large constnat to u, w and u, we may assume 
that 

v > 1, iw > 1, inSii\{0}. 
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Let £ = rj = ^ and C = ^- Since Aw < in \ {0}, a straight forward 
calculation yields 

A£ = —u~ 2 Au + 2ii~ 3 |V'u| 2 > 0, ui£h\{0}. 
Similarly, we have 

An > 0, AC > 0, in Br. 

Clearly 7/(0) = C(0), Vr?(0) ^ VC(0) and f > in B«\{0}. It follows from Lemma 1 
that limsup^(x) < 77(0), i.e., liminf u(x) > w(0). Lemma 2 is established. 

□ 

Proposition 1 For n > 3, let U C S nxn be open and satisfy (1) and (2), and let 
F G C 1 (?7) satisfy (3) and (4)- Assume that u G C 2 (R n \ {0}) a positive function 
satisfying 

F{A U ) = 1, A" G E/, in R n \ {0}, (22) 
Aw < 0, in FT \ {0}, (23) 

and 

Uq : i can be extended to a C 2 function near the origin, (24) 
where u 0jl (x) := j^iu(j^). 

We further assume that there exist some constant S > and v G C 2 {B$) such that 

Av < inB s . (25) 

Vu(0) = 0, (26) 
u - v > inB s \ {0}, (27) 
liminf(w-?j)(x) = 0. (28) 

Fhen u is radially symmetric, i. e, 

u{x) = u{y), V \x\ = \y\ > 0. (29) 

Moreover u'(r) < /or V r > 0, where we have used u(r) to denoted the radially 
symmetric function u. 
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Lemma 3 Let u e C°(B 2 \ {0}) satisfy 

Au < in B 2 \ {0} in the distribution sense, 



and inf u > — oo. T/ien 
s 2 \{o} 



u > minw on £>i \ {0}. 

dBi 



Proof of Lemma 3. For e > 0, consider v e (x) := e(l — , i_ 2 ) + miriM. Then 

A(v e -w)>0 inS^-jO}, (v e -w)<0 on95i. 
Since limsup(f e (x) — u(x)) = —oo, we deduce from the maximum principle that 

v e -u<0 onfix^O}. 
Fix any x in _Bi\{0}, and send e — > 0, we have > min it. Lemma 3 is established. 

dBi 

□ 

Proof of Proposition 1. By the positivity of u and by (23), we have uo,i > and 
Auo,i < on R n \ {0}. By Lemma 3, 

inf u > 0, minw O i>0. (30) 

Bi\{0} Bi U,i V 7 

If u can be extended to a C 1 function near the origin, then, by theorem 1.2 in [6], 
u is of the form (7) for some x G R n and some positive constants o and 6. By (27), 
(28) and (26), Vu(0) = 0, and therefore x — 0. Proposition 1 is proved in this 
case. In the rest of the proof of Proposition 1, we always assume that u can not be 
extended to a C 1 function near the origin. 

By (30) and the repeatedly used arguments in [8], [6] and [7], we can prove that 
V x G R n \ {0}, there exists A (x) > such that 

UxAv) ■= (-^—) n - 2 u(x+ X ! {y ~\ 2 ) ) < <y), V0 < A < A (x), \y-x\ >X,y^0. 
\y — x\ \y — x\ z 

Set 

X(x) = sup{0 < /I < \x\ | u X:X (y) < u(y), V \y - x\ > A, y ^ 0, < A < /j,}. 
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We distinguish into two cases. 
Case 1. 3 x e R n \ {0} such that \{x) < \x\. 
Case 2. \{x) = \x\ for V x E R n \ {0}. 

In Case 1, we have 

u StX (y) < u(y), V < A < \(x), \y-x\>\,y^0. (31) 
After a rotation, we may assume that x = x\t\ with x\ > 0. 
Lemma 4 Vu 2 ~ m (0) ^ 0. 
Proof of Lemma 4. Suppose the contrary, 

V%,a ( ,)(0) = 0. (32) 

A direct calculation yields that 

\Jb\ ^ 



By (32), 



(n - 2)\x\u((l - (^-) 2 )x) = X(x) 2 d lU ((l - (^l) 2 )x). (33) 
\x\ \x\ 



Consider w(s) := u(x — Spy) for s > 0. By (31) with y = x — , 
A A 2 

(-) n ~ 2 t/;(— ) < w(s), V A < s < \x\, V < A < A(x). 

5 5 



^2 n 2 n 2 

It follows (with t = — ) that t~^~w(t) < s^~w(s) V0<Ks< A(x), and therefore 
(note that ^§p < A(x)) 

, n — 'l 

— (s 2 w(s))\ ^ > 0, 
as s— |s| 



i.e., 



^— ^ u ((l - (^) 2 )x) > - (^) 2 )x). (34) 



By (33) and (34), ^((l - (^) 2 )x) > (n - 2)u((l - (^f 1 ) 2 )^). This is a contra- 
diction, since w((l — (^-) 2 ):r) and n — 2 > 0. Lemma 4 is established. 
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□ 

Since X(x) < \x\, we have, by (31), that % ; vx) < u in an open neighborhood 
of the origin. Since u is a C 2 superharmonic function in R n \ {0}, u s ^(^(x) is a 
superharmonic function in an open neighborhood of the origin. We first show that 

]immf\yr 2 (u-u,- m )(y)>0. (35) 

Indeed, let £(x) = j^u(^) and r){x) = j^2U s - m (j^). By the hypothesis on 
u, both £ and can be extended as a C 2 positive function near the origin. Since 
the equation satisfied by u is conformally invariant, we have 

F(A^) = F(A V ) = 1, A^, A n E U, in an open neighborhood of the origin. 

We also know that £ > rj in an open neighborhood of the origin. If (35) does not 
hold, then £(0) = 77(0) . By the arguments in the proof of lemma 2.1 in [6] which are 
based on the strong maximum principle while using only the fairly weak ellipticity 
hypotheses (2) and (4), we have £ = rj near the origin, i.e., u(y) = u s ^\{y) for 
large \y\. Again, by the same arguments, u = m 5 ,a(x)> anc ^ i n particular u can be 
extended as a C 2 function near the origin, violating our assumption that u does not 
have such an extension. We have proved (35). 

Similarly, also using arguments in the proof of lemma 2.1 in [6] (based on the Hopf 
lemma and the strong maximum principle), we have 

^(«-%,A(s))lsB X(e) (x) >0, (36) 

where jj; denotes the outer normal differentiation with respect to B\^(x). 
Again, by using the strong maximum principle as in the proof of lemma 2.1 in [6] 
(recall that we always assume that u can not be extended as a C 1 function near the 
origin), we have 

(«- «x,a(x))(z/) > 0> v \y~x\ > X(x), y + 0. (37) 
Because of (35), (36), and the definition of X(x), we must have, as usual, 

limjnf(w - u s - m )(y) = 0. (38) 

On the other hand, applying Lemma 2 to u with w = u 5 ,a(x) (note that V%,a(x)(0) 7^ 
Vv(0) due to (26) and Lemma 4), we have liminf(u — u^x^)(x) > 0, violating (38). 
Case 1 is settled. 
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In Case 2, we have, V x G R n \ {0}, 

u x ,M<u(y), y\y-x\>\, y^O, < A < (39) 
For e G R n with ||e|| = 1 and \x > 0, let 

S M (e) := G iT| y ■ e < »}, u e '"(y) := ii(y e >"), 
where y e,M denotes the mirror symmetry point of y with respect to the plane <9E^(e). 
Lemma 5 W e E R n with ||e|| = 1 and V /i > 0, we have 

u e '^y)<u(y), V y G E M (e) \ {0}. 

Proof of Lemma 5. Without loss of generality, we may assume e = e\. For any 

fixed pi > 0, let x — x(R) = Re 1 for R > fi, and let A = X(R) — R — fi. By (39), 

u x ,\(y) <u(y), V y G E M (ei) \ {0}. 
Fix y G S M (ei), we deduce from the above that 

> lim ^(y) = lim (-A-)- 2 ^ + ~ *> ) = «(^). 

-R^oo i?^oo |y — x| |y — X| 

Here we have used the fact that lim (x + A , ^A^ ) = -y ei,M . Lemma 5 is established. 

□ 

It follows from Lemma 5 that w is radially symmetric, and as usual, by the Hopf 
Lemma (as in the proof of lemma 2.1 in [6], using only the fairly weak ellipticity 
hypotheses (2) and (4)), we have u'(r) < for V r > 0. Proposition 1 is established. 

□ 

Proposition 2 For n > 3, let U C S nxn be open and satisfy (1) and (2) and let 
F G C 1 (?7) satisfy (3) and (4)- Assume that u G C 2 (R n \ {0}) is a positive radially 
symmetric function satisfying (22), (24) and 

u'{r) < 0, V < r < oo. (40) 

Then either u(r) = c °"^"" f or u is of the form (7) with x = and some positive 
constants a and b satisfying 2b 2 a~ 2 I G U and F{2h 2 a~ 2 I) = 1. 
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Proof of Proposition 2. If we know lim (r|it'(r)|) = 0, then, by theorem 1.2 in 

[6], u is of the form (7). By the radial symmetry of u, x — 0. Since oo is regular 
point of u, b must be positive. Proposition 2 is proved in this case. In the following, 
we assume that 

lim sup(— ru'(r)) = limsup(r|w'(r)|) > S > 0, (41) 

and we will show that u(r) = co ^ a f . 
By (41), we can find r { — > + such that 

-nu'in) >S, Vi. (42) 

Since u is positive in R n \ {0} and u'(r) < for V r > 0, we have ^inf ^ u{r) > u{l) > 
0. By (24), oo is a regular point of u. As usual we have, for large A > 0, that 

u x (x) := (A) n ' 2 u(r^) < u(x), V < \x\ < A. 

Here and below we have abused notation slightly by writing u(x) = u(\x\). 
For any fixed i, set 

Aj := {fi > ri | -ua(^) < u(x), forall < |x| < A, V A > 

Lemma 6 lim \ = 0. 

Proof of Lemma 6. Suppose not, then for some positive constant 8± > and along 
a subsequence, we have Aj > 5 > r«. By the usual arguments based on the strong 
maximum principle, the Hopf lemma and our ellipticity hypothesis, a touching must 
occur at r = r iy i.e., u^in) — u ( r i)- Recall that u^ir) < u ( r ) for V r« < r < A«. 
Thus 

u'(n) > uUn). (43) 



Since u is regular at oo y(24) J and Aj > 5± > 0, we have 

\u' h (n)\<C (44) 
for some constant C > independent of On the other hand, we have, by (42), 

lim u'{r-i) = — oo. (45) 

We reach a contradiction from (43), (44) and (45). Lemma 6 is established. 

□ 
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Lemma 7 lim u(r) = oo. 

Proof of Lemma 7. For any fixed A > 0, we have, by Lemma 6, \ < X for large 
i. By the definition of Aj, we have, for large i, 

U\{x) < u(x), V Ti < \x\ < A. 

For any fixed x G B\ \ {0}, send i — > oo, we have Wa(^) < It follows that for 

any fixed A > 0, we have 

A A 2 x 

liminfwfx) > lim U\(x) = lim (— — ) n ~ 2 u(— —) 
|x|-»o v 7 _ |x|-»o v 7 |x|-o v |a;|'' v |x| 2/ 

= lim n A 2 -^ ,i(^) = A 2 -^o,i(0). 

|x|— >0 A 



Here we have used (24). 

Sending A — > 0, we have established Lemma 7. 



□ 



By Lemma 7, 

liminf(|xr-V),i( x )) = 00 ■ ( 46 ) 

|x|— >oo 

We also know u ,i G C 2 (R n ) is a positive solution of 

i^yT - 1 ) = 1, A U0A G C/, on R n . 

Let to = Mo,i- Starting from any point x G R n , the moving phere procedure can get 
started and can never stop due to (46). This follows from our usual arguments (see 
[8], [6], [7]). Thus we have 

Wx,\{y) < w(y), V x G R n , < A < oo, \y - x\ > A. 

By a calculus lemma (see, e.g., lemma 11.2 in [8]), w =constant, i.e., u(r) = co "nl° wt • 
Proposition 2 is established. 

□ 

Proof of Theorem 1. Using the positivity and the superharmonicity of u on R n , 
we have, by the maximum principle, liminf(|x| n " 2 ti(x)) > minw > 0. With this, we 

|x|^oo dBi 

have, as usual, that for any x G R n , there exists some Xq(x) > such that 
u x ,x(y) < u(y), V \y - x\ > A, < A < X (x). 
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Set, for x G R n , 

X(x) := {/i > | u Xt \(y) < u(y), V\y-x\>\, < A < //}. 

If X(x) = oo for any x G R n , then, as usual, -u ^constant. We're done {b = in (7)). 
So, we only need to deal with the situation that < X(x) < oo for some x G R n . 
The moving sphere procedure stops at A = X(x), therefore, as usual, we have that 

\imM\yr 2 (u-u sMs) )(y) = 0, (47) 

(u-u srm )(y)>0, V\y-x\>\(x). (48) 

Let 0i (x) := x + X{ f x ^ x) , we know = where := \ J^\^{uo 0i), 

denotes the Jacobian of 0i. Pick any x ^ x and let 

2 (x) := x + — u-^Ufa, v : 



Then w G C 2 (R n \ {x}), oo is a regular point of w (i.e., A) can be extended 

to a positive C 2 function near the origin), A-u < in i? n \{z}, v G C 2 (i? n \{02 1 (^)})> 
oo is a regular point of v (since x ^ x), Av < in R n \ {02 m > ii in an open 

neighborhood of x (because of (48)), and liminf(£t — v)(x) = (because of (47)). 

x^x 

By (1) and the conformal invariance of the equation satisfied by u, we have 

F(A") = 1, A*eU, mR n \{x}. 

Since i ^ i, we have 02~ 1 (x) therefore v is a positive C 2 function near x. 

If Vv(x) = 0, then, by applying Proposition 1 to u(x) := u(x + x), u is radially 
symmetric and 

u(r) < 0, V < r < oo. 
Next, by applying Proposition 2 to u, we have either 

„ . . constant . , . 

< x ) = -[ip=5-' < 49 > 

or, for some positive constants a and b, 

^)-(t^v)^- ( 5 °) 
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If (49) occurs, then u =constant, i.e., u is of the form (7) with 6 = and some 
a > 0. If (50) occurs, then 

u (y) = ] — ^=2 fl ( i 1 -i ) = ; | Q — ^)^' 

and therefore u is of the form (7). Thus we have proved Theorem 1 provided that 
Vv(x) = 0. If Vv(x) 7^ 0, we will make a suitable Mobius transformation to reduce 
it to the situation with Vv(x) = 0. For this, we need the following fact (used in the 
proof of theoerm 1.1 in [6]). 

Lemma 8 Let s > 0, y, p G R n \ {0} with n > 3 and y = ^"^ p. Assume that £ is 
a C 1 function near y satisfying £(y) = s and V£(y) = p. Then 

(v^)(V" 1 (y)) = o J 

where ip(x) := /or any /ized A > 0. 

Lemma 8 follows from a direct computation. 

Back to the proof of Theorem 1, when Vv(x) ^ 0, let s = v(x) > 0, p = 
Vv(x) ^ 0, and y = Sffip. Define £(x) := ^(x - y + x), i/,(x) := Ijg?. By 
Lemma 8, (V^)(V> _1 (y)) = 0. Now let 

T)(x) = U(X - y + X), U = TJif,, V = 

Then -u e C 2 (R n \ {V ;_1 (?/)}), oo is a regular point of u, Au < in R n \ {if)~ 1 (y)}, v 
is a positive C 2 superharmonic function in an open neighborhood of i(j~ 1 (y), u > v 
in an open neighborhood of ip^^y), 

liminf (u — v)(x) = 0, 

and 

F(A*) = 1, A*eU, in R n \{jjj- 1 (y)}. 

Now we also know that Vv^~ 1 (y)) = 0. So we have, by applying Proposition 1 to 
u*(x) := u(x + V ; ~ 1 (?/)) ! that u* is radially symmetric and 

(u*)'(r) < 0, V < r < oo. 



Applying Proposition 2 to w*, we have either 
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or, for some positive constants a and 6, 

"*m = (iVk^- (52) 

If (51) occurs, we have « =constant. If (52) occurs, u is of the form (7) and u is not 
a constant. Theorem 1 is established. 

□ 
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